Consumption of data services provisioned in cloud infrastructures

ABSTRACT

An aspect of the present disclosure facilitates consumption of data services provisioned in cloud infrastructures. In one embodiment, a name server maintains a node-map data reflecting the corresponding set of nodes (in cloud infrastructures) currently hosting each of multiple data services. A consumer system (e.g. an end user system or another node in the cloud infrastructure) seeking to access a desired data service, sends to the name server a resolution request containing an identifier of the desired data service. The consumer system receives from the name server, identifiers of a set of nodes currently hosting the desired data service and then accesses the desired data service through at least one of the set of nodes.

PRIORITY CLAIM

The present disclosure claims priority to U.S. Provisional PatentApplication No. 62/665,496, filed May 1, 2018, entitled “ORCHESTRATIONOF DISTRIBUTED DATABASES SPANNING DIVERSE CLOUD INFRASTRUCTURES,” andU.S. Provisional Patent Application No. 62/690,344, filed Jun. 26, 2018,entitled “ORCHESTRATION OF DISTRIBUTED DATABASES SPANNING DIVERSE CLOUDINFRASTRUCTURES,” both of which are incorporated herein by reference intheir entireties.

RELATED APPLICATIONS

The present application is related to the following co-pendingapplications, which are both incorporated in their entirety into thepresent application:

1. Entitled, “ORCHESTRATION OF DATA SERVICES IN MULTIPLE CLOUDINFRASTRUCTURES”, Ser. No.: 16/398,279, Filed on Apr. 30, 2019, namingas inventors Bharat Chandra Baddepudi, et al.

2. Entitled, “ SELECTION OF LEADER NODES IN DISTRIBUTED DATA SERVICES”,Ser. No.: 16/398,281, Filed on Apr. 30, 2019, now issued as U.S. Pat.No. 10,749,951, naming as inventors Bogdan-Alexandru Matican, et al.

BACKGROUND OF THE DISCLOSURE Technical Field

The present disclosure relates to cloud computing and more specificallyto consumption of data services provisioned in cloud infrastructures.

Related Art

Data services refer to implementations designed to provide access(storage and retrieval) to basic data using data storages. The basicdata can be used by higher level applications such as electronic mail,enterprise applications, etc., as is well known in the relevant arts.Common examples of such data services are databases and file systems.Data services are referred to as ‘data as a service’ (DaaS) in severalenvironments.

Data services are often provided based on cloud infrastructures. Cloudinfrastructure refers to a collection of processing nodes, connectivityinfrastructure, data storages, etc., which are engineered to togetherprovide a virtual computing infrastructure for various customers, withthe scale of such computing infrastructure being specified often ondemand. Many vendors such as Amazon, Google, Microsoft, etc., providecorresponding public cloud infrastructures that span multiple continentscurrently.

Consumption of data services refers to usage of the data services byhigher level applications to access desired data maintained in the datastorages. Specifically, applications access desired data elements byinteracting with data services according to pre-specified conventions.In the context of cloud infrastructures, the higher level applicationsmay be executing in the nodes (such as application servers) of cloudinfrastructure or may be applications executing in systems (such asend-user systems) external to the cloud infrastructure.

Aspects of the present disclosure relate to consumption of data servicesprovisioned in cloud infrastructures.

BRIEF DESCRIPTION OF THE DRAWINGS

Example embodiments of the present disclosure will be described withreference to the accompanying drawings briefly described below.

FIG. 1 is a block diagram illustrating an example environment (computingsystem) in which several aspects of the present disclosure can beimplemented.

FIG. 2 is a flowchart illustrating the manner in which consumption ofdata services provisioned in cloud infrastructures is facilitatedaccording to an aspect of the present disclosure.

FIG. 3A depicts the internal details of a distributed database (exampledata service) in one embodiment.

FIG. 3B depicts the manner in which distributed databases (example dataservices) are hosted in cloud infrastructures in one embodiment.

FIGS. 4A-4C depicts sample user interfaces provided forprovisioning/creation of a distributed database (example data service)in one embodiment.

FIGS. 5A and 5B depicts sample node-map data maintained for distributeddatabases (example data services) provisioned in cloud infrastructuresin one embodiment.

FIG. 5C depicts portions of an application consuming a distributeddatabase (example data service) provisioned in cloud infrastructures inone embodiment.

FIGS. 6A-6C depicts sample user interfaces provided for viewing thedetails of a provisioned distributed database (example data service) inone embodiment.

FIG. 7 is a block diagram illustrating an example implementation of aninfrastructure independent control plane (admin console application)provided in an orchestration server in one embodiment.

FIG. 8 is a block diagram illustrating the details of a digitalprocessing system in which various aspects of the present disclosure areoperative by execution of appropriate executable modules.

In the drawings, similar reference numbers generally indicate identical,functionally similar, and/or structurally similar elements. The drawingin which an element first appears is indicated by the leftmost digit(s)in the corresponding reference number.

DETAILED DESCRIPTION OF THE EMBODIMENTS OF THE DISCLOSURE

1. Overview

An aspect of the present disclosure facilitates consumption of dataservices provisioned in cloud infrastructures. In one embodiment, a nameserver maintains a node-map data reflecting the corresponding set ofnodes (in cloud infrastructures) currently hosting each of multiple dataservices. A consumer system (e.g., an end user system or another node inthe cloud infrastructure) seeking to access a desired data service,sends to the name server a resolution request containing an identifierof the desired data service. The consumer system receives from the nameserver, identifiers of a set of nodes currently hosting the desired dataservice and then accesses the desired data service through at least onenode of the set of nodes.

According to another aspect of the present disclosure, the correspondingset of nodes currently hosting a data service spans first and secondcloud infrastructures, and the set of nodes (sent in response to aresolution request) includes a first node from the first cloudinfrastructure and a second node from the second cloud infrastructure.Accordingly, a consumer system is facilitated to consume data servicesprovisioned in multiple cloud infrastructures.

According to one more aspect of the present disclosure, thecorresponding set of nodes currently hosting a data service includesmultiple nodes. Upon the resolution request including a qualifier alongwith the identifier of the data service, a name server sends only thenodes of the multiple nodes matching the qualifier as a response to theresolution request. Accordingly, a consumer system is facilitated torequest for nodes of the data service that match desired qualifiers.

According to yet another aspect of the present disclosure, the multiplenodes hosting a data service are organized into multiple groups, eachgroup being identified by a corresponding group identifier. A consumersystem specifies a desired group identifier as the qualifier (along withthe identifier of the data service) in a resolution request and receivesnodes of a group identified by the desired group identifier as the setof nodes hosting the data service.

According to an aspect of the present disclosure, the groups of nodeshosting a data service includes a primary cluster containing a primaryset of nodes for the data service, and a read-replica cluster containinga secondary set of nodes for the data service. A resolution requestaccordingly includes a qualifier that specifies one of the primarycluster and the read replica cluster (along with the identifier of thedata service).

In one embodiment, a consumer system specifies the primary cluster as aqualifier in a resolution request, receives identifiers of the primaryset of nodes as the set of nodes hosting the data service, and thenperforms a write operation on one of the primary set of nodes. Inanother embodiment, the consumer system specifies the read replicacluster as the qualifier, receives identifiers of the secondary set ofnodes as the set of nodes hosting the data service, and then performs aread operation on one of the secondary set of nodes.

According to another aspect of the present disclosure, the groups ofnodes hosting a data service represent corresponding regions. A consumersystem specifies the identifier of a region in which the consumer systemis present as the qualifier (along with the identifier of the dataservice) in a resolution request and receives nodes of the region as theset of nodes hosting the data service. Accordingly, the consumer systemis facilitated to access the data service with low latency (in view ofthe consumer system and the accessed node being in the same region).

According to one more aspect of the present disclosure, the groups ofnodes hosting a data service are formed according to availability zonesand/or cloud infrastructures. As such, a consumer system is facilitatedto retrieve the identifiers of the nodes in each availability zoneand/or cloud infrastructure hosting a desired data service.

According to an aspect of the present disclosure, an orchestrationserver receives commands for performing orchestration tasks, with eachorchestration task designed to change the corresponding set of nodeshosting corresponding data services. The name server maintains thechanged set of nodes hosting each data service after performance of thecorresponding orchestration task such that a consumer system is providedidentifiers of the changed set of nodes currently hosting each dataservice.

In one embodiment, the corresponding set of nodes hosting a data serviceforms a universe for that data service, with the orchestration tasksincluding expanding the universe, shrinking the universe, and migrationof the universe. The expanding of the universe causes addition of atleast one node to the corresponding set of nodes, the shrinking of theuniverse causes removal of at least one node from the corresponding setof nodes, and the migration of the universe causes replacement of atleast one node of the corresponding set of nodes with another node.

According to another aspect of the present disclosure, the orchestrationserver also operates as the name server (described above), with eachdata service being a distributed database.

According to one more aspect of the present disclosure, each node (incloud infrastructures) is identified by a corresponding IP (InternetProtocol) address in the node-map data maintained by a name server. Thenode-map data is propagated is propagated to an external DNS (DomainName System) server such that consumer systems can thereafter access theIP addresses of nodes providing each data service by interfacing withthe external DNS server.

In one embodiment, the node-map data is also maintained according to DNSin the name server.

Several aspects of the present disclosure are described below withreference to examples for illustration. However, one skilled in therelevant art will recognize that the disclosure can be practiced withoutone or more of the specific details or with other methods, components,materials and so forth. In other instances, well-known structures,materials, or operations are not shown in detail to avoid obscuring thefeatures of the disclosure. Furthermore, the features/aspects describedcan be practiced in various combinations, though only some of thecombinations are described herein for conciseness.

2. Example Environment

FIG. 1 is a block diagram illustrating an example environment (computingsystem) in which several aspects of the present disclosure can beimplemented. The block diagram is shown containing cloud infrastructures110 and 120, network 130, provisioning systems 140A-140C, orchestrationserver 150, end user systems 160A-160D, DNS (Domain Name System) server170 and data store 180. The provisioning systems and end user systemsare collectively referred to by 140 and 160 respectively.

Merely for illustration, only representative number/type of blocks isshown in the FIG. 1. Many environments often contain many more blocks,both in number and type, depending on the purpose for which theenvironment is designed. Each block of FIG. 1 is described below infurther detail.

Each of cloud infrastructures 110 and 120 is collection of processingnodes, connectivity infrastructure, data storages, etc., which areengineered to together provide a virtual computing infrastructure forvarious customers, with the scale of such computing infrastructure beingspecified often on demand. The nodes can be virtual nodes (e.g., virtualmachines (VMs), containers containing one or more VMs) operating basedon physical nodes, physical nodes themselves, or a combination as well.

It may be appreciated that the cloud infrastructures typically spanseveral continents and are provided by different vendors. In addition,each cloud infrastructure may vary substantially from another in termsof interface requirements, scale, technical characters of nodes,hardware/software/network implementation, etc., and thus the cloudinfrastructures are said to be diverse. Examples of such diverse cloudinfrastructures include, but are not limited to, public clouds such asAmazon Web Services (AWS) Cloud available from Amazon.com, Inc., GoogleCloud Platform (GCP) available from Google LLC, etc., and private cloudssuch as On-Premises clouds owned by the customers.

Cloud infrastructure (C1) 110 is shown containing nodes (processing orstorage, shown as squares) located in two different geographical regionsR1 and R2. Each region is shown containing multiple availability zones(named as Z1, Z2, etc.), each having independent support infrastructuresuch as power, networking, etc. Each availability zone (e.g., C1-R1-Z1)can thus operate independent of other zones, such that the availabilityzone can continue to operate even upon the failure of the other zones(e.g., C1-R1-Z2 and C1-R1-Z3). Cloud infrastructure (C2) 120 issimilarly shown with regions R1, R3, R4 with respective regional sets ofavailability zones, with each availability zone containing respectivenodes.

Network 130 represents a network providing connectivity between cloudinfrastructures 110 and 120, provisioning systems 140, orchestrationserver 150, end user systems 160 and DNS server 170. Network 110 may bean internetwork (including the world-wide connected Internet), anintranet, a combination of internetwork and intranet, etc. Network 110may be implemented using protocols such as Transmission Control Protocol(TCP) and/or Internet Protocol (IP), well known in the relevant arts.

In general, in TCP/IP environments, a TCP/IP packet is used as a basicunit of transport, with the source address being set to the TCP/IPaddress assigned to the source system from which the packet originatesand the destination address set to the TCP/IP address of the targetsystem to which the packet is to be eventually delivered. An IP packetis said to be directed to a target system when the destination IPaddress of the packet is set to the IP address of the target system,such that the packet is eventually delivered to the target system bynetwork 130. When the packet contains content such as port numbers,which specifies a target application, the packet may be said to bedirected to such application as well.

Each of the provisioning systems 140A-140C is designed to controlconfiguration of nodes within a corresponding cloud infrastructure.Thus, provisioning systems 140A and 140B may respectively be forcontrolling cloud infrastructures 110 and 120, and be provided byvendors of the respective cloud infrastructures. Provisioning system140C represents a similar system, but provided by third party vendors(who do not provide the cloud infrastructure themselves). Thusprovisioning system 140C may communicate directly with the correspondingcloud infrastructure (say 120) or interface with the vendor providedprovisioning system (140B) to cause the corresponding configuration.Communication directly implies that the corresponding instruction isencoded in IP packets directed to (the nodes of) the cloudinfrastructure. Examples of third party provisioning systems include,but are not limited to, Ansible available from Red Hat Inc, TerraFormavailable from HashiCorp, Inc, etc.

DNS server 170 represents a server system that translates (typicallyuser-friendly) domain names into IP addresses needed for locating andaccessing computer services and devices (in general network entities)with the underlying network protocols. As is well known, the Domain NameSystem is a hierarchical and decentralized naming system for networkentities connected to network 130, with each entity having an associatednetwork location (IP address) and also a user-friendly domain name.

Data store 180 represents a non-volatile (persistent) storagefacilitating storage and retrieval of data (details of nodes, etc.) byapplications executing in orchestration server 150. Data store 180 maybe implemented as a corresponding database server using relationaldatabase technologies and accordingly provide storage and retrieval ofdata using structured queries such as SQL (Structured Query Language).Alternatively, data store 180 may be implemented as a corresponding fileserver providing storage and retrieval of data in the form of filesorganized as one or more directories, as is well known in the relevantarts.

Each of end user systems 160A-160D represents a system such as apersonal computer, workstation, mobile device, computing tablet etc.,used by users/customers to generate (user) requests directed toapplications executing in orchestration server 150. The user requestsmay be generated using appropriate user interfaces (e.g., web pagesprovided by an application executing in the server, a native userinterface provided by a portion of an application downloaded from theserver, etc.). In general, end user system requests an application forperforming desired tasks and receives the corresponding responses (e.g.,web pages) containing the results of performance of the requested tasks.The web pages/responses may then be presented to the user/customer atend user systems 160 by client applications such as the browser.

Orchestration server 150 represents a server system, such as aweb/application server, executing applications designed to perform tasksrequested by users/customers using end user systems 160. Specifically,orchestration server 150 facilitates users/customers to performorchestration of data services in cloud infrastructures (such as 110 and120). Orchestration of a data service typically entails creation orformation of a collection of processing nodes and data storage nodes(hereafter referred to as “universe”) for hosting the data service, anypreparatory steps thereto (checking node availability, etc.),configuration of the nodes in the universe to provide the data service,and/or subsequent administrative tasks (hereafter referred to as“orchestration tasks”). Examples of such orchestration tasks includeexpanding/shrinking the universe, replacing nodes of the universe ondemand (i.e., migrating application/data to another node), increasingreplication factor, taking backups, restoring from a backup,upgrading/downgrading the data service implementation, etc.

After provisioning, a data service may be used/consumed (to accessdesired data maintained in the data storages) by higher levelapplications executing in other nodes (such as application servers) ofcloud infrastructures 110/120 or executing in end user systems 160external to cloud infrastructures 110/120. In the following description,the term “consumer system” is used to refer to any system (such as nodesof cloud infrastructures 110/120 or end user systems 160) executinghigher level applications designed to consume/access the basic dataprovided by data services provisioned in cloud infrastructures.

It may be readily appreciated that a consumer system desiring access toa target data service needs to be provided with the details (e.g.identifiers, IP addresses) of the universe (set of nodes) hosting thetarget data service. Once the universe is provided, the consumer systemmay connect to a desired node of the universe to perform desired dataoperations (e.g. write operation, read operation) with the basic dataprovided by the target data service.

Orchestration server 150, extended according to several features of thepresent disclosure, facilitates the consumption of data servicesprovisioned in cloud infrastructures as described below with examples.

3. Consumption of Data Services Provisioned in Cloud Infrastructures

FIG. 2 is a flowchart illustrating the manner in which consumption ofdata services provisioned in cloud infrastructures is facilitatedaccording to an aspect of the present disclosure. The flowchart isdescribed with respect to the systems of FIG. 1, in particular,orchestration server 150, merely for illustration. However, many of thefeatures can be implemented in other environments also without departingfrom the scope and spirit of several aspects of the present invention,as will be apparent to one skilled in the relevant arts by reading thedisclosure provided herein.

In addition, some of the steps may be performed in a different sequencethan that depicted below, as suited to the specific environment, as willbe apparent to one skilled in the relevant arts. Many suchimplementations are contemplated to be covered by several aspects of thepresent invention. The flow chart begins in step 201, in which controlimmediately passes to step 210.

In step 210, orchestration server 150 maintains a node-map datareflecting the corresponding nodes currently provisioned for multipledata services. In one embodiment, the node-map data is in the form of amapping between user understandable identifiers of data services tocorresponding sets of IP addresses of the collection of nodes (universe)provisioned for the data services in cloud infrastructures 110 and 120.

The node-map data may be maintained as a database/table maintained indata store 180 (implemented as a database server using relationaldatabase technologies). Alternatively, the node-map data source may bemaintained in one or more files in data store 180 (when implemented as afile server).

According to an aspect, the node-map data also reflects thecharacteristics associated with the nodes of the universe hosting eachdata service. For example, when the universe of a data service isorganized into multiple groups (with each group being identified by acorresponding group identifier), the node-map data also reflects thegroups associated with each node within the universe. The groups may beformed according to one of operation type (primary cluster vsread-replica cluster), regions (C1-R1, C1-R2, etc.), availability zones(C2-R2-Z1, C2-R2-Z2, etc.), and cloud infrastructures (C1, C2, etc.).

In step 230, orchestration server 150 receives from a consumer system aresolution request containing an identifier of a data service (sought tobe accessed). Orchestration server 150 then identifies based on thenode-map data, a set of nodes forming a universe hosting the specifieddata service. In the embodiment noted above, orchestration server 150may inspect the mapping/node-map data to identify the set of IPaddresses corresponding to the identifier of the data service receivedin the request.

In the scenario that the resolution request includes a qualifier,orchestration server 150 identifies only the nodes of the universematching the qualifier. For example, when the qualifier is a groupidentifier, only the nodes identified by/associated with the specifiedgroup identifier are identified by orchestration server 150.

In step 250, orchestration server 150 sends a resolution response (tothe requesting consumer system) indicating the nodes hosting the dataservice specified in the resolution request. If the resolution requestincluded a qualifier, the identifiers of only the nodes hosting the dataservice and matching the qualifier are indicated in the resolutionresponse.

In step 270, the consumer system accesses the data service through atleast one of the nodes indicated in the resolution response. As notedabove, accessing may entail sending access requests directed to one ormore nodes of the universe using the data (e.g. IP addresses) providedin the resolution response and receiving corresponding responses fromthe nodes. The access requests may specify desired data operations (e.g.write operation, read operation) to be performed with the basic dataprovided by the data service. The flowchart ends in step 299.

Thus, orchestration server 150 operates as a name server that translatesuser friendly identifiers to IP addresses needed for locating andaccessing data services with the underlying network protocols. Aconsumer system is accordingly relieved of the burden of tracking thedetails (e.g. IP addresses) of the nodes forming the universe hosting aspecific data service. Such an architecture providing a level ofindirection allows for changes to provisioned nodes for each dataservice without forcing changes to the higher levelapplications/consumer systems that send the access requests.

According to an aspect of the present disclosure, orchestration server150 propagates the node-map data to an external DNS (Domain Name System)server such that consumer systems can thereafter access the IP addressesof nodes providing each data service.

The manner in which orchestration server 150 facilitates the consumptionof data services provisioned in cloud infrastructures according to theoperation of FIG. 2 is illustrated below with examples.

4. Example Data Service

In the following sections, several aspects of the present disclosure areillustrated with respect to a distributed database as an example of adata service. However the features of the present disclosure may beimplemented with respect to other data services (e.g., file server,replicated databases) as well, as will be apparent to one skilled in therelevant arts by reading the disclosure herein.

A distributed database is often implemented based on multiple nodes thatcooperatively provide a unified view of database interfaces, whileshielding the users from the underlying storage and processing of data.Distributed databases thus provide for fault tolerance (of nodes orstorage), enhanced performance, data redundancy (by a replicationfactor), etc., as is well known in the relevant arts.

FIG. 3A depicts the internal details of a distributed database (exampledata service) in one embodiment. Distributed database 300 is a group ofnodes such as VMs, physical machines or containers (referred to as a“universe”) that collectively function as a highly available andresilient distributed database. For illustration, the universe ofdistributed database 300 is shown containing three nodes 310A-310C,though in alternative embodiments, distributed databases contain feweror more nodes depending on the purpose for which the database isdesigned.

Distributed database 300 is a system-of-record/authoritative databasethat geo-distributed applications can rely on for correctness andavailability. Distributed database 300 allows applications to easilyscale up and scale down across multiple regions in the public cloud,on-premises data centers or across hybrid environments without creatingoperational complexity or increasing the risk of outages.

Distributed database 300 may be deployed in a variety of configurationsdepending on business requirements, and latency considerations. Someexamples are single availability zone (zone/rack/failure domain),multiple availability zones in a region, multiple regions (withsynchronous and asynchronous replication choices), etc. An example ofsuch a distributed database is YugaByte DB available from YugaByte, Inc.The components of distributed database 300 are described in detailbelow.

In one embodiment, the universe of distributed database 300 consists ofone or more keyspaces, with each keyspace being a namespace that cancontain one or more database tables. Distributed database 300automatically shards, replicates and load-balances these database tablesacross the nodes in the universe, while respecting user-intent such ascross-AZ or region placement requirements, desired replication factor,and so on. Distributed database 300 automatically handles failures(e.g., node, availability zone or region failures), and re-distributesand re-replicates data back to desired levels across the remainingavailable nodes while still respecting any data placement requirements.

Distributed database 300 has two components—Master process and TServerprocess. The Master (Server) processes are responsible for keepingsystem metadata/records, such as what tables exist in the system, wheretheir tablets live, what users/roles exist, the permissions associatedwith them, etc. Master processes also are responsible for coordinatingsystem-wide operations such as create/alter drop tables and initiatingmaintenance operations such as load-balancing or initiatingre-replication of under-replicated data. The Master process' executingin the different nodes (310A-310B) are not in the critical path of IOagainst user tables (which is handled by TServer processes as describedbelow).

The TServer processes are responsible for hosting/serving user data(e.g., database tables). Each TServer process does the actual IO for enduser requests received from user applications. The user requests may beaccording to the various protocols supported by distributed database300. Query Layer, executing as part of each TServer process, implementsthe server-side of multiple protocols/APIs that distributed database 300supports such as Apache Cassandra CQL, Redis APIs, SQL API, etc.

In one embodiment, each database table is split/sharded into one or moretablets based on groups of primary keys. Each tablet is composed of oneor more tablet-peers depending on the replication factor, with eachTServer process hosting one or more tablet-peers. The manner in which atable having one or more tablets with a replication factor of 3 (thatis, 3 peers) may be maintained in nodes 310A-310C is depicted in FIG. 3.

Each TServer process also coordinates operations across tablets hostedby it by using techniques such as server-global block cache (leading tohighly efficient memory utilization in cases when one tablet is readmore often than others), throttled compactions (to prevent highforeground latencies during a compaction storm), small/large compactionqueues to keep the system functional even in extreme IO patterns,server-global memstore limits, auto-sizing of block cache/memstore,striping tablet load uniformly across data disks, etc.

In one embodiment, the Master and TServer processes use Raft, adistributed consensus algorithm, for replicating changes to systemmetadata or user data respectively across a set of nodes. The detail ofthe Raft consensus algorithm is available in the paper entitled “InSearch of an Understandable Consensus Algorithm (Extended Version)” byDiego Ongaro and John Ousterhout of Stanford University. Specifically,the Master process' executing in the different nodes (310A-310B) forms aRaft group with its peers, while the tablet-peers (e.g. “tablet 1, peer1”, “tablet 1, peer 2”, etc.) corresponding to each tablet (e.g. “tablet1”) hosted on different TServers (in nodes 310A-310C) form acorresponding Raft group and replicate data between each other.

Thus, the Master and TServer processes along with the operation of Raftgroups provides for a transactional, high performance distributeddatabase (300) for planet-scale applications. It may be appreciated thatmultiple distributed databases similar to database 300 may be hosted bycloud infrastructures 110 and 120. The manner in which multipledistributed databases may be hosted in multiple cloud infrastructures isdescribed in detail below.

FIG. 3B depicts the manner in which distributed databases (example dataservices) are hosted in multiple cloud infrastructures in oneembodiment. For illustration, only a sample set of universes (hostingdistributed databases) in a single cloud infrastructure is shown in theFigure. However, the features of the present disclosure can beimplemented for universes spanning multiple availability zones and/orregions and/or cloud infrastructures, as will be apparent to one skilledin the relevant arts by reading the disclosure herein.

Specifically, four data services labeled D1, D2, D3 and D4 are shown inFIG. 3B with the corresponding nodes (shown as squares) distributedamong three availability zones Z1, Z2 and Z3 within geographical regionsR1 and R2 in cloud infrastructure C1. In the following description, dataservice D1 is assumed to correspond to distributed database 300.

Data service D1 is shown hosted by the universe of nodes 331-333distributed among multiple availability zones and geographical regionsto provide features such as fault tolerance, enhanced performance, dataredundancy, etc. The other data services (D2, D3, etc.) are similarlyshown hosted on corresponding sets of nodes labeled with the identifierof the data service (D2, D3, etc.).

The manner in which orchestration server 150 facilitates theprovisioning/creation of distributed database 300 is described belowwith examples.

5. Provisioning of a Distributed Database

FIGS. 4A-4C depicts sample user interfaces provided forprovisioning/creation of a distributed database (example data service)in one embodiment. Display areas 400 and 430 represent a respectiveportion of a user interface displayed on a display unit (not shown)associated with end user system 160. In one embodiment, display area400/430/470 corresponds to a web page rendered by a browser executing onend user system 160. Web pages are provided by orchestration server 150in response to a user sending appropriate requests (for example, byspecifying corresponding URLs in the address bar) using the browser.

Referring to FIG. 4A, display area 400 depicts a “Dashboard” web pagethat is displayed in the browser (executing in end user system 160) inresponse to a user/customer specifying a URL in the browser address bar.Display area 410 depicts the various distributed database universes(clusters) that have been previously been provisioned by the customer.Display area 420 depicts the universes graphically on a world map, witheach circle indicating a corresponding region and the number within thecircle indicating the corresponding number of zones in which nodes havebeen provisioned for the customer. The user/customer may click/selectdisplay area 415 to indicate creation of a new universe (distributeddatabase).

Referring to FIG. 4B, display area 330 depicts a “Create Universe” webpage that is displayed in the browser in response to the user/customerclicking/selecting display area 415 in FIG. 4A. Display area 440facilitates the user/customer to specify a name for the universe/cloud(e.g. “xdc-read-replicas”), the specific provider (e.g. “GCP-config”),the specific regions (e.g. “GCP-Oregon”), the number of nodes (e.g. 3)and the replication factor (e.g. 3).

It may be appreciated that the user/customer may select any desirednumber and/or combination of desired providers and/or regions and/ornodes in the interface of display area 440. For example, to create auniverse in AWS, the user may specify the provider as “AWS-new” and thespecific region(s) as “AWS-Oregon”.

In response to the user/customer specifying the details in display area440, orchestration server 150 determines the availability zones in theregions selected in display area 440 and the distribution of thecustomer specified nodes among the zones and displays the correspondinginformation in display area 450. In display area 450, the “Preferred”check box has been shown selected for all of the zones gcp-us-west1-a,gcp-us-west1-b, and gcp-us-west1-c indicating that all the three zonesare preferred (in other words, there is no specific zone that is morepreferred than the others) for the leader nodes.

The user/customer may then specify the desired node distribution (1 nodein each zone) among the different zones shown in display area 450 andalso the details of the instance to be provisioned (e.g. “n-standard-1”)on the nodes in display area 455. The user/customer may also specify oneor more advanced options (not shown for conciseness) in display area460. After specifying the desired details, the user/customer mayclick/select “Create” button 490 to indicate the creation of thespecified universe.

In one embodiment, the user/customer clicks/selects “Configure ReadReplica” button 465 to configure the read replication details. The readreplica is a cluster of nodes that maintains a read-only copy of thedata in an asynchronous manner from the nodes in the primary cluster(shown in FIG. 3A). Such a read replica may be desirable when thelatency of doing a distributed consensus based write among the nodes inthe primary cluster is not tolerable for some workloads.

Referring to FIG. 4C, display area 470 depicts a “Create Universe (ReadReplica)” web page that is displayed in the browser in response to theuser/customer clicking/selecting button 465 in FIG. 4B. The displayareas (e.g. 480 and 485) shown in FIG. 4C operate similar to thecorresponding display areas (e.g. 440 and 450) of FIG. 4B, andaccordingly their description is not repeated here for conciseness. Itmay be appreciated that the user/customer may select (in display area480) a combination of providers and/or regions for the read replicadifferent from that selected (in display area 440) for the primarycluster. After specifying the desired details, the user/customer mayclick/select “Create” button 490 to indicate the creation of thespecified universe.

In response to the user/customer selecting button 490 in FIG. 4C,orchestration server 150 then performs one or more underlying tasks forcreating the customer specified universe/distributed database such asprovisioning the nodes, configuring the nodes, initiating the Masterprocesses on the nodes, waiting for the master processes to be alive,initiating the TServer processes on the nodes, and waiting for theTServer processes to be alive.

Orchestration server 150 performs the tasks noted above by sendingappropriate commands to provisioning systems 140A-140C to cause thecreation/provisioning of the distributed database (300). Orchestrationserver 150 also maintains a node-map data specifying the details ofdistributed databases orchestrated in multiple cloud infrastructures asdescribed below with examples.

6. Node-Map Data

FIGS. 5A and 5B depicts sample node-map data maintained for distributeddatabases (example data services) provisioned in cloud infrastructuresin one embodiment. For illustration, the node-map data is assumed to bemaintained in the form of tables in data store 180. However, inalternative embodiments, the node-map data may be maintained accordingto other data formats (such as files according to extensible markuplanguage (XML), etc.) and/or using other data structures (such as lists,trees, etc.), as will be apparent to one skilled in the relevant arts byreading the disclosure herein.

In one embodiment, the node-map data is maintained consistent with DNS(Domain Name System) technology. In particular, A/CNAME records aremaintained indicating the nodes in each universe. As is well known, an“A” record maps a name/identifier to an IP (Internet Protocol) addressof the node, while a “CNAME” record maps a name/identifier to anothername/identifier (which may be further translated to an IP address basedon another DNS record by the same or another DNS server).

Referring to FIG. 5A, table 500 depicts a portion of node-map datacontaining one or more rows/records. Column 511 (“Name”) specifies aunique name/identifier for each record, column 512 (“Type”) specifiesthe type of the record such as “A”, “CNAME”, etc. and column 513(“Value”) specifies the values associated with the uniquename/identifier.

Thus, rows 521-528 correspond to records maintained by orchestrationserver 150 for distributed databases (example data services)orchestrated in multiple cloud infrastructures. Specifically, rows 521and 522 correspond to records that are required for propagation to anexternal DNS server, in this case, Route 53 DNS provided by Amazon WebServices. Additional such records specific to other DNS servers maysimilarly be maintained as part of node-map data (table 500).

Row/record 523 specifies the IP addresses of the nodes belonging to theuniverse “xdc-read-replicas.universe.yugabyte.com” created using theuser interfaces of FIGS. 4A-4C. It may be observed that the name“xdc-read-replicas.universe.yugabyte.com” is mapped to nodes in GCP(10.150.0.36, 10.150.0.42, 10.150.0.42). The specific IP addresses maybe received by orchestration server 150 after performing the creation ofthe database universe specified in the user interfaces of FIGS. 4A-4C.In particular, orchestration server 150 issues commands and receives theIP address (along with other details) of the nodes provisioned byprovisioning systems 140A-140C. Orchestration server 150 then insertsrow/record 523 in table 500.

Rows/records 524-528 specify subsets/groups of nodes of the distributeddatabase universe. Specifically, rows/records 524 and 526 specifysubsets grouped by clusters (primary cluster, read-replica cluster,etc.) while rows/records 527 and 528 specify groups organized bygeographical regions (west-coast, east-coast, etc.), which facilitatesaddressability of such groups of nodes. It may be observed thatrow/record 525 is of type CNAME and is accordingly mapped to anothername/identifier.

It may be appreciated that orchestration server 150 also updates therows/records in table 500 according to relevant changes (adding orremoving nodes or any data configuration options such as placementinformation or instance definitions) in the underlying database universeas described below with examples.

7. Update of Node-Map Data

In one embodiment, orchestration server 150 updates the node-map tablein response to performing orchestration tasks for expanding/shrinkingthe universe of the distributed database based on demand, zero downtimemigrations of a deployment: from one hardware type to another; from onecloud provider to another, expand a deployment/universe to one or moreadditional cloud providers, etc.

Referring to FIG. 5B, table 500 depicts portions of node-map dataupdated after performance of an orchestration task. In particular, thenode-map data is shown after performance of an expand universe task with3 new nodes. Row 551 indicates that the record for“xdc-read-replicas.universe.yugabyte.com” has been updated with the IPaddresses of the additional 3 nodes. In addition, row/record 552indicates that the corresponding groups have also been updated with theIP addresses of the 3 new nodes. Rows 553 and 554 indicate that the newIP addresses have been added to the relevant geographical locationgroups.

Similarly, in response to shrink universe orchestration task receivedfrom the customer, table 500 may be updated to remove the IP addressesof the nodes removed from the universe. Also, in response to migrationof the universe orchestration task, table 500 may be updated to replaceone or more IP address of the nodes with different IP address (of thenodes to where the data service has been migrated).

Thus, orchestration server 150 maintains different types of DNS recordsin data storage locally within orchestration server 150 or in data store180, independent of any configuration data maintained by the cloudinfrastructures. As such, these DNS records can be shared with allconsumer systems that require access to the underlying data and wouldthus require a one-time configuration to encode these DNS records(leaving it up to orchestration server 150 to account for underlyingchanges in the record set).

It should be noted that when resolution requests for a data service arereceived at time instances that the node-map data is as shown in FIG.5A, row 523 indicates the current set of nodes hosting the distributeddatabase (data service) and accordingly the IP addresses in row 523 areprovided as a (resolution) response to such resolution requests. Forsubsequent resolution requests received after update of the node-mapdata shown in FIG. 5B, row 551 indicates the current set of nodes andaccordingly IP address in row 551 are provided as a response to thesubsequent resolution requests. Accordingly, accurate responses aregenerated even as changes are effected by execution of orchestrationcommands

The manner in which the node-map data of FIGS. 5A/5B is used during theconsumption of the distributed database is described below withexamples.

8. Consuming a Distributed Database

FIG. 5C depicts portions of an application consuming a distributeddatabase (example data service) provisioned in cloud infrastructures inone embodiment. The application may be executing in a consumer system(one of nodes of cloud infrastructures 110/120 or one of end usersystems 160).

Data portion 560 depicts the manner in which an application (or a partthereof) connects to nodes of a primary cluster of a universe (here“primary-cluster.xdc-read-replicas.universe.yugabyte.com”) and executeone or more write (INSERT) operations. Data portion 560 specificallycauses a write operation to be sent to (and executed on) one of thenodes from the primary cluster.

Data portion 570 depicts the manner in which an application (or a partthereof) connects to nodes of a read-replica cluster of a universe (here“read-replica.xdc-read-replicas.universe.yugabyte.com”) and execute oneor more read (SELECT) operations. Data portion 570 specifically causes aread operation to be sent to (and executed on) one of the nodes from theread-replica cluster.

Data portion 580 depicts the manner in which an application (or a partthereof) connects to nodes in a specific region (in which the consumersystem is located) of a universe (here“east-coast.xdc-read-replicas.universe.yugabyte.com”) and execute one ormore operations. Data portion 580 specifically causes a read operationto be sent to (and executed on) one of the nodes in the “east-coast”region. The read operation may be performed with low latency in view ofthe consumer system and the node executing the read operation being inthe same region.

Thus, the node-map data maintained by orchestration server 150facilitates the consumption of the distributed database (data service)provisioned in cloud infrastructures 110/120. According to an aspect ofthe present disclosure, orchestration server 150 propagates the node-mapdata of table 500 to an external DNS (Domain Name System) server such asRoute 53 DNS provided by Amazon Web Service noted above. The propagatedrecords facilitate the consumer systems to access the correspondinginformation when sending operations to distributed database 300.

Such an architecture providing a level of indirection that allows forchanges to provisioned nodes for each distributed database withoutforcing changes to the consumer systems/higher level applications ishighly desirable in data services (such as distributed databases), wherethe elasticity, mobility and ease of reconfiguration provides thecustomers a great deal of potential flexibility, whether it is scalingtheir universes up or down, migrating to a new set of instances withmore resources, shifting workloads across regions or zones, or spanningacross multiple clouds.

In addition, since orchestration server 150 provides a seamlessintegration over various APIs of public clouds (AWS, GCP, Azure, etc),private deployments (on-premise) as well as containerized environments(Docker, Kubernetes), the addressability mechanism operates as a native,unified point of entry for the user/customer, abstracting away from theindividual APIs.

Furthermore, orchestration server 150 may provide consumer systems withvarious aliases (names/identifiers) for more granular addressabilityoptions. These would cover both slicing individual universes (bygeo-location, cloud, region, zone, etc.) as described above, as well asallowing for separation of various deployment environments, such asproduction, QA, development, etc. (since each distributed databasedeployment and each customer, would be namespaced separately). All ofthese aliases would be managed by orchestration server 150 and have thesame elasticity guarantees.

Thus, orchestration server 150 facilitates the provisioning of adistributed database (possibly spanning diverse cloud infrastructure)and also operates as a name server facilitating consumer systems toconsume the distributed database (data service). The user/customer mayview the details of the universe as described below with examples.

9. Viewing Details of a Provisioned Distributed Database

FIGS. 6A-6C depicts sample user interfaces provided for viewing thedetails of a provisioned distributed database (example data service) inone embodiment. Display area 600 represents a portion of a userinterface displayed on a display unit (not shown) associated with enduser system 160. In one embodiment, display area 600 corresponds to aweb page rendered by a browser executing on end user system 160. Webpages are provided by orchestration server 150 in response to a usersending appropriate requests (for example, by specifying correspondingURLs in the address bar) using the browser.

Display area 600 of FIG. 6A, similar to display area 400 of FIG. 4A,displays a “Dashboard” page but with the newly created universe“xdc-read-replicas” (created using the interfaces of FIGS. 4A-4C) shownin display area 610. The user/customer may then click/select displayarea 615 to view the details of the newly created universe.

Display area 600 of FIG. 6B accordingly depicts an “Overview” web pagethat is displayed in the browser (executing in end user system 160) inresponse to a user/customer selecting the universe named“xdc-read-replicas” by clicking/selecting display area 615 of FIG. 6A.Display area 610 depicts the details of the provisioned nodes such asthe number of nodes, the number of CPUs, the total storage, etc., whiledisplay area 615 depicts the details of the cost of the provisionednodes. Display area 620 depicts the details of the primary cluster suchas the specific cloud provider (GCP), the region and the zone to whichthe nodes belong, while display area 625 depict the correspondingdetails of the read replica cluster.

Display area 600 of FIG. 6C depicts the “Nodes” web page that isdisplayed in the browser in response to a user/customer selecting thetab “Nodes” in FIG. 6B. Display area 640 specifies the details of thenodes that are provisioned as part of the universe. In particular,display area 640 depicts respective tables of nodes allocated to theprimary cluster and the read replica during provisioning/creation ofdistributed database 300. It may be readily observed that the nodesshown in display area 640 correspond to the nodes shown in rows 524 and526 of FIG. 5A.

Thus, a user/customer is facilitated to view the details of a previouslyprovisioned distributed database. The manner in which orchestrationserver 150 is implemented in one embodiment is described below withexamples.

10. Orchestration Server

According to an aspect of the present disclosure, orchestration server150 provides an infrastructure independent control plane fororchestration of distributed data services such as distributed databasesin multiple cloud infrastructures. In one embodiment, an admin consoleapplication (described below) executing in orchestration server 150provides the control plane for installing, managing and orchestratingseveral aspects of the distributed databases. An example of such anadmin console application is the YugaWare application available fromYugaByte, Inc.

FIG. 7 is a block diagram illustrating an example implementation of aninfrastructure independent control plane (admin console application)provided in an orchestration server in one embodiment. The block diagramis shown containing user interface (UI) layer 710, applicationprogramming interface (API) layer 720, cloud infrastructure interface(CII) 780 and cloud implementations 790A-290D. API layer 720 in turn isshown containing orchestration engine 750, dynamic discovery 730,pluggable pricing engine 740, secure deployment 760, monitoring andmetrics 770.

Merely for illustration, only representative number/type of blocks isshown in the FIG. 7. In addition, the blocks are shown executing inorchestration server 150. Many environments often contain many moreblocks, both in number and type, with some of the blocks executing inother systems/servers, depending on the purpose for which theenvironment is designed. Each block of FIG. 7 is described below infurther detail.

UI layer 710 receives user requests from (users/customers using) enduser system 160 and sends appropriate web pages as correspondingresponses to the user requests. UI layer 710 also receives inputsprovided by the users in the provided web pages and invokes thecorresponding modules in API layer 720. In one embodiment, UI layer 710is implemented using React JS.

API layer 720 contains one or more modules implementing correspondingfunctionalities provided by the control plane. For example,orchestration engine 750 facilitates the orchestration of a distributeddatabase spanning diverse cloud infrastructures. Dynamic discovery 730,provided according to several aspects of the present disclosure,facilitates discovery of new nodes based on configuration such that theprovisioning of an application/service can be modified without affectingother applications/services. Pluggable pricing engine 740 facilitatesusers/customers to view the approximate costs of provisioning of adistributed database including what-if scenarios.

Secure deployment 760 facilitates the secured provisioning/deployment ofthe distributed databases including features such as network isolation,encryption, access control, etc. Monitoring and metrics 770 facilitatesusers/customers to monitor various metrics such as CPU usage, memoryusage, requests processed, etc. associated with the virtual/physicalnodes on which a distributed database has been provisioned. In oneembodiment, the modules of API layer 720 are implemented in Java™programming language.

In one embodiment, the admin console application makes orchestrationtasks intent based, and greatly simplifies operational complexity. Theseintents can be specified via UI layer 710. In other words, theuser/customer using UI layer 710 specifies the intent of theorchestration, with the modules in API layer 720 then performing variousunderlying tasks associated with the intent without requiring theuser/customer to either specify or be aware of the underlying tasks.

Examples of such intents covering the entire life-cycle of a distributeddatabase include, but are not limited to, creation of a distributeddatabase (described above), expanding/shrinking the distributed databasebased on demand, deploy data across fault domains (multi-zone,multi-region, multi-cloud configurations), zero downtime databasesoftware upgrade, zero downtime migrations of a deployment: from onehardware type to another; from one cloud provide to another, stretchinga deployment from one cloud to another cloud.

In an embodiment, the implementations of each of such intents areinvocable by corresponding calls of an API, e.g., via a REST API. Such afeature can be the basis for implementing automation of various tasksassociated with distributed databases. For example, an automated scriptcan be implemented by appropriate calls to the API to expand the numberof nodes in the database universe during expected peak usage durationsand to shrink (reduce the number of nodes in) the database universeduring non-peak usage durations.

CII 780 provides a cloud agnostic interface to the modules in API layer720, such that the modules are facilitated to be implemented withouthaving any cloud specific details. Each of cloud implementations790A-790D represents a corresponding module that is specific to a cloudinfrastructure such as AWS, GCP, On-Premises, etc. CII 780 inassociation with cloud implementations 790A-790D together operate toconvert high-level tasks invoked from API layer 720 to the correspondingactual set of commands specific to the cloud infrastructure, as willapparent to one skilled in the relevant arts. The commands may be sentto one or more of provisioning systems 140A-140C, which in turn causethe commands to be executed in the corresponding cloud infrastructure(110 and 120). In one embodiment, CII 780 and cloud implementations790A-790D (or portions thereof) are implemented in Python™ programminglanguage.

Thus, orchestration server 150 implements an infrastructure independentcontrol plane that facilitates several features of the presentdisclosure.

It should be appreciated that the features described above can beimplemented in various embodiments as a desired combination of one ormore of hardware, software, and firmware. The description is continuedwith respect to an embodiment in which various features are operativewhen the software instructions described above are executed.

11. Digital Processing System

FIG. 8 is a block diagram illustrating the details of digital processingsystem 800 in which various aspects of the present disclosure areoperative by execution of appropriate executable modules. Digitalprocessing system 800 may correspond to any one of orchestration server150, end user systems 160 and provisioning systems 140.

Digital processing system 800 may contain one or more processors such asa central processing unit (CPU) 810, random access memory (RAM) 820,secondary memory 830, graphics controller 860, display unit 870, networkinterface 880, and input interface 890. All the components exceptdisplay unit 870 may communicate with each other over communication path850, which may contain several buses as is well known in the relevantarts. The components of FIG. 8 are described below in further detail.

CPU 810 may execute instructions stored in RAM 820 to provide severalfeatures of the present disclosure. CPU 810 may contain multipleprocessing units, with each processing unit potentially being designedfor a specific task. Alternatively, CPU 810 may contain only a singlegeneral-purpose processing unit.

RAM 820 may receive instructions from secondary memory 830 usingcommunication path 850. RAM 820 is shown currently containing softwareinstructions constituting shared environment 825 and/or other userprograms 826 (such as other applications, DBMS, etc.). In addition toshared environment 825, RAM 820 may contain other software programs suchas device drivers, virtual machines, etc., which provide a (common) runtime environment for execution of other/user programs.

Graphics controller 860 generates display signals (e.g., in RGB format)to display unit 870 based on data/instructions received from CPU 810.Display unit 870 contains a display screen to display the images definedby the display signals (for example, the portions of the user interfacesshown in FIGS. 4A-4C and 6A-6C). Input interface 890 may correspond to akeyboard and a pointing device (e.g., touch-pad, mouse) and may be usedto provide inputs (for example, the user inputs provided in the abovenoted user interfaces). Network interface 880 provides connectivity to anetwork (e.g., using Internet Protocol), and may be used to communicatewith other systems (of FIG. 1) connected to the network (130).

Secondary memory 830 may contain hard drive 835, flash memory 836, andremovable storage drive 837. Secondary memory 830 may store the data(for example, portions of data of FIGS. 5A and 5B, data/commands sent toprovisioning systems 140) and software instructions (for example, forimplementing the actions of FIG. 2, etc.), which enable digitalprocessing system 800 to provide several features in accordance with thepresent disclosure. The code/instructions stored in secondary memory 830may either be copied to RAM 820 prior to execution by CPU 810 for higherexecution speeds, or may be directly executed by CPU 810.

Some or all of the data and instructions may be provided on removablestorage unit 840, and the data and instructions may be read and providedby removable storage drive 837 to CPU 810. Removable storage unit 840may be implemented using medium and storage format compatible withremovable storage drive 837 such that removable storage drive 837 canread the data and instructions. Thus, removable storage unit 840includes a computer readable (storage) medium having stored thereincomputer software and/or data. However, the computer (or machine, ingeneral) readable medium can be in other forms (e.g., non-removable,random access, etc.).

In this document, the term “computer program product” is used togenerally refer to removable storage unit 840 or hard disk installed inhard drive 835. These computer program products are means for providingsoftware to digital processing system 800. CPU 810 may retrieve thesoftware instructions, and execute the instructions to provide variousfeatures of the present disclosure described above.

The term “storage media/medium” as used herein refers to anynon-transitory media that store data and/or instructions that cause amachine to operate in a specific fashion. Such storage media maycomprise non-volatile media and/or volatile media. Non-volatile mediaincludes, for example, optical disks, magnetic disks, or solid-statedrives, such as storage memory 830. Volatile media includes dynamicmemory, such as RAM 820. Common forms of storage media include, forexample, a floppy disk, a flexible disk, hard disk, solid-state drive,magnetic tape, or any other magnetic data storage medium, a CD-ROM, anyother optical data storage medium, any physical medium with patterns ofholes, a RAM, a PROM, and EPROM, a FLASH-EPROM, NVRAM, any other memorychip or cartridge.

Storage media is distinct from but may be used in conjunction withtransmission media. Transmission media participates in transferringinformation between storage media. For example, transmission mediaincludes coaxial cables, copper wire and fiber optics, including thewires that comprise bus 850. Transmission media can also take the formof acoustic or light waves, such as those generated during radio-waveand infra-red data communications.

Reference throughout this specification to “one embodiment”, “anembodiment”, or similar language means that a particular feature,structure, or characteristic described in connection with the embodimentis included in at least one embodiment of the present disclosure. Thus,appearances of the phrases “in one embodiment”, “in an embodiment” andsimilar language throughout this specification may, but do notnecessarily, all refer to the same embodiment.

Furthermore, the described features, structures, or characteristics ofthe disclosure may be combined in any suitable manner in one or moreembodiments. In the above description, numerous specific details areprovided such as examples of programming, software modules, userselections, network transactions, database queries, database structures,hardware modules, hardware circuits, hardware chips, etc., to provide athorough understanding of embodiments of the disclosure.

12. Conclusion

While various embodiments of the present disclosure have been describedabove, it should be understood that they have been presented by way ofexample only, and not limitation. Thus, the breadth and scope of thepresent disclosure should not be limited by any of the above-describedexemplary embodiments.

It should be understood that the figures and/or screen shots illustratedin the attachments highlighting the functionality and advantages of thepresent disclosure are presented for example purposes only. The presentdisclosure is sufficiently flexible and configurable, such that it maybe utilized in ways other than that shown in the accompanying figures.

What is claimed is:
 1. A computing system comprising: a plurality ofcloud infrastructures containing nodes hosting a plurality of dataservices, each data service being hosted on a corresponding set of nodesat a corresponding time duration, wherein the corresponding set of nodeshosting a data service forms a universe for that data service; a nameserver maintaining a node-map data reflecting the corresponding set ofnodes currently hosting each of said plurality of data services; and anorchestration server which receives commands for performingorchestration tasks, with each orchestration task designed to change thecorresponding set of nodes hosting corresponding data services, whereinsaid name server maintains the changed set of nodes hosting each dataservice after performance of the corresponding orchestration task suchthat said consumer system is provided identifiers of the changed set ofnodes currently hosting said first data service, wherein saidorchestration tasks comprise at least one of expanding the universe,shrinking the universe, and migration of the universe, wherein expandingof the universe causes addition of at least one node to thecorresponding set of nodes, wherein shrinking of the universe causesremoval of at least one node from the corresponding set of nodes,wherein migration of the universe causes replacement of at least onenode of the corresponding set of nodes with another node, and wherein aconsumer system is operable to perform the actions of: sending to saidname server a resolution request containing an identifier of a firstdata service sought to be accessed; receiving from said name server,identifiers of a first set of nodes currently hosting said first dataservice; and accessing said first data service through at least one ofsaid first set of nodes.
 2. The computing system of claim 1, wherein thecorresponding set of nodes currently hosting said first data servicespans a first cloud infrastructure and a second cloud infrastructure,wherein said first set of nodes includes a first node from said firstcloud infrastructure and a second node from said second cloudinfrastructure.
 3. The computing system of claim 1, wherein thecorresponding set of nodes currently hosting said first data servicecomprises a first plurality of nodes, wherein said first set of nodesincludes only those of said first plurality of nodes matching saidqualifier.
 4. The computing system of claim 3, wherein said firstplurality of nodes are organized into a plurality of groups, each groupbeing identified by a corresponding group identifier, wherein saidconsumer system specifies a desired group identifier as said qualifierand receives nodes of a group identified by said desired groupidentifier as said first set of nodes.
 5. The computing system of claim4, wherein said plurality of groups includes a primary clustercomprising a primary set of nodes for said first data service, and aread-replica cluster comprising a secondary set of nodes for said firstdata service, wherein said qualifier specifies one of said primarycluster and said read replica cluster.
 6. The computing system of claim5, wherein said consumer system specifies said primary cluster as saidqualifier and receives identifiers of said primary set of nodes as saidfirst set of nodes, wherein said accessing comprises a write operationon one of said primary set of nodes.
 7. The computing system of claim 5,wherein said consumer system specifies said read replica cluster as saidqualifier and receives identifiers of said secondary set of nodes assaid first set of nodes, wherein said accessing comprises a readoperation on one of said secondary set of nodes.
 8. The computing systemof claim 4, wherein said plurality of groups represents a plurality ofregions, wherein said consumer system specifies the identifier of aregion in which said consumer system is present as said qualifier andreceives nodes of said region as said first set of nodes, whereby saidaccessing of said first data service is facilitated to be performed withlow latency.
 9. The computing system of claim 4, wherein said pluralityof groups is formed according to one of deployment environments,availability zones and cloud infrastructures.
 10. The computing systemof claim 1, wherein said wherein said orchestration server also operatesas said name server, wherein each data service of said plurality of dataservices is a distributed database.
 11. The computing system of claim 1,wherein each node is identified by a corresponding IP (InternetProtocol) address in said node-map data, said computing system furthercomprising an external DNS (Domain Name System) server to which saidnode-map data is propagated such that said consumer system canthereafter access the IP addresses of nodes providing each data service.12. The computing system of claim 11, wherein said node-map data is alsomaintained according to DNS in said name server.
 13. A non-transitorymachine readable medium storing one or more sequences of instructions,wherein execution of said one or more sequences of instructions by oneor more processors contained in one or more servers causes said one ormore servers to perform the actions of: maintaining a node-map datareflecting a corresponding set of nodes currently hosting each of aplurality of data services, wherein the corresponding set of nodeshosting a data service forms a universe for that data service;determining the performance of orchestration tasks, with eachorchestration task designed to change the corresponding set of nodeshosting corresponding data services, wherein said orchestration taskscomprise at least one of expanding the universe, shrinking the universe,and migration of the universe, wherein expanding of the universe causesaddition of at least one node to the corresponding set of nodes, whereinshrinking of the universe causes removal of at least one node from thecorresponding set of nodes, wherein migration of the universe causesreplacement of at least one node of the corresponding set of nodes withanother node; updating said node-map data to reflect the changed set ofnodes hosting each data service after performance of the correspondingorchestration task; receiving, from a consumer system, a resolutionrequest containing an identifier of a first data service sought to beaccessed; and sending identifiers of a first set of nodes currentlyhosting said first data service based on said node-map data such thatsaid consumer system is provided identifiers of the changed set of nodescurrently hosting said first data service.
 14. The non-transitorymachine readable medium of claim 13, wherein the corresponding sets ofnodes are provided in a plurality of cloud infrastructures, wherein saidfirst set of nodes includes a first node from a first cloudinfrastructure and a second node from a second cloud infrastructure. 15.The non-transitory machine readable medium of claim 13, wherein thecorresponding set of nodes currently hosting said first data servicecomprises a first plurality of nodes, wherein said resolution requestincludes a qualifier along with said identifier, further comprising oneor more instructions for: including in said first set of nodes onlythose of said first plurality of nodes matching said qualifier.
 16. Thenon-transitory machine readable medium of claim 15, wherein said firstplurality of nodes are organized into a plurality of groups, each groupbeing identified by a corresponding group identifier, wherein saidresolution request specifies a desired group identifier as saidqualifier and said including includes nodes of a group identified bysaid desired group identifier in said first set of nodes.
 17. Thenon-transitory machine readable medium of claim 16, wherein saidplurality of groups are formed according to one of operation type,regions, availability zones, cloud infrastructures.
 18. Thenon-transitory machine readable medium of claim 13, further comprisingone or more instructions for: determining the performance oforchestration tasks, with each orchestration task designed to change thecorresponding set of nodes hosting corresponding data services; andupdating said node-map data to reflect the changed set of nodes hostingeach data service after performance of the corresponding orchestrationtask such that said consumer system is provided identifiers of thechanged set of nodes currently hosting said first data service.
 19. Thenon-transitory machine readable medium system of claim 13, wherein eachnode is identified by a corresponding IP (Internet Protocol) address insaid node-map data, further comprising one or more instructions forpropagating said node-map data to an external DNS (Domain Name System)server such that said consumer system can thereafter access the IPaddresses of nodes providing each data service.
 20. The non-transitorymachine readable medium of claim 19, wherein said node-map data is alsomaintained according to DNS in a name server contained in said one ormore servers, wherein each data service of said plurality of dataservices is a distributed database.
 21. A method performed by one ormore servers, said method comprising: maintaining a node-map datareflecting a corresponding set of nodes currently hosting each of aplurality of data services, wherein the corresponding set of nodeshosting a data service forms a universe for that data service;determining the performance of orchestration tasks, with eachorchestration task designed to change the corresponding set of nodeshosting corresponding data services, wherein said orchestration taskscomprise at least one of expanding the universe, shrinking the universe,and migration of the universe, wherein expanding of the universe causesaddition of at least one node to the corresponding set of nodes, whereinshrinking of the universe causes removal of at least one node from thecorresponding set of nodes, wherein migration of the universe causesreplacement of at least one node of the corresponding set of nodes withanother node; updating said node-map data to reflect the changed set ofnodes hosting each data service after performance of the correspondingorchestration task; receiving, from a consumer system, a resolutionrequest containing an identifier of a first data service sought to beaccessed; and sending identifiers of a first set of nodes currentlyhosting said first data service based on said node-map data such thatsaid consumer system is provided identifiers of the changed set of nodescurrently hosting said first data service.
 22. The method of claim 21,wherein the corresponding sets of nodes are provided in a plurality ofcloud infrastructures, wherein said first set of nodes includes a firstnode from a first cloud infrastructure and a second node from a secondcloud infrastructure.
 23. The method of claim 21, wherein thecorresponding set of nodes currently hosting said first data servicecomprises a first plurality of nodes, wherein said resolution requestincludes a qualifier along with said identifier, further comprising oneor more instructions for: including in said first set of nodes onlythose of said first plurality of nodes matching said qualifier.
 24. Themethod of claim 23, wherein said first plurality of nodes are organizedinto a plurality of groups, each group being identified by acorresponding group identifier, wherein said resolution requestspecifies a desired group identifier as said qualifier and saidincluding includes nodes of a group identified by said desired groupidentifier in said first set of nodes.
 25. The method of claim 24,wherein said plurality of groups are formed according to one ofoperation type, regions, availability zones, cloud infrastructures. 26.The method of claim 21, further comprising one or more instructions for:determining the performance of orchestration tasks, with eachorchestration task designed to change the corresponding set of nodeshosting corresponding data services; and updating said node-map data toreflect the changed set of nodes hosting each data service afterperformance of the corresponding orchestration task such that saidconsumer system is provided identifiers of the changed set of nodescurrently hosting said first data service.
 27. The method of claim 21,wherein each node is identified by a corresponding IP (InternetProtocol) address in said node-map data, further comprising one or moreinstructions for propagating said node-map data to an external DNS(Domain Name System) server such that said consumer system canthereafter access the IP addresses of nodes providing each data service.28. The method of claim 27, wherein said node-map data is alsomaintained according to DNS in a name server contained in said one ormore servers, wherein each data service of said plurality of dataservices is a distributed database.